Improving emotion perception in cochlear implant users: insights from machine learning analysis of EEG signals.

BACKGROUND: Although cochlear implants can restore auditory inputs to deafferented auditory cortices, the quality of the sound signal transmitted to the brain is severely degraded, limiting functional outcomes in terms of speech perception and emotion perception. The latter deficit negatively impacts cochlear implant users' social integration and quality of life; however, emotion perception is not currently part of rehabilitation. Developing rehabilitation programs incorporating emotional cognition requires a deeper understanding of cochlear implant users' residual emotion perception abilities. METHODS: To identify the neural underpinnings of these residual abilities, we investigated whether machine learning techniques could be used to identify emotion-specific patterns of neural activity in cochlear implant users. Using existing electroencephalography data from 22 cochlear implant users, we employed a random forest classifier to establish if we could model and subsequently predict from participants' brain responses the auditory emotions (vocal and musical) presented to them. RESULTS: Our findings suggest that consistent emotion-specific biomarkers exist in cochlear implant users, which could be used to develop effective rehabilitation programs incorporating emotion perception training. CONCLUSIONS: This study highlights the potential of machine learning techniques to improve outcomes for cochlear implant users, particularly in terms of emotion perception.

Integrating Emotion Perception in Rehabilitation Programs for Cochlear Implant Users: A Call for a More Comprehensive Approach.

PURPOSE: Postoperative rehabilitation programs for cochlear implant (CI) recipients primarily emphasize enhancing speech perception. However, effective communication in everyday social interactions necessitates consideration of diverse verbal social cues to facilitate language comprehension. Failure to discern emotional expressions may lead to maladjusted social behavior, underscoring the importance of integrating social cues perception into rehabilitation initiatives to enhance CI users' well-being. After conventional rehabilitation, CI users demonstrate varying levels of emotion perception abilities. This disparity notably impacts young CI users, whose emotion perception deficit can extend to social functioning, encompassing coping strategies and social competence, even when relying on nonauditory cues such as facial expressions. Knowing that emotion perception abilities generally decrease with age, acknowledging emotion perception impairments in aging CI users is crucial, especially since a direct correlation between quality-of-life scores and vocal emotion recognition abilities has been observed in adult CI users. After briefly reviewing the scope of CI rehabilitation programs and summarizing the mounting evidence on CI users' emotion perception deficits and their impact, we will present our recommendations for embedding emotional training as part of enriched and standardized evaluation/rehabilitation programs that can improve CI users' social integration and quality of life. CONCLUSIONS: Evaluating all aspects, including emotion perception, in CI rehabilitation programs is crucial because it ensures a comprehensive approach that enhances speech comprehension and the emotional dimension of communication, potentially improving CI users' social interaction and overall well-being. The development of emotion perception training holds promises for CI users and individuals grappling with various forms of hearing loss and sensory deficits. Ultimately, adopting such a comprehensive approach has the potential to significantly elevate the overall quality of life for a broad spectrum of patients.

Music perception in acquired prosopagnosia.

BACKGROUND: Acquired prosopagnosia is often associated with other deficits such as dyschromatopsia and topographagnosia, from damage to adjacent perceptual networks. A recent study showed that some subjects with developmental prosopagnosia also have congenital amusia, but problems with music perception have not been described with the acquired variant. OBJECTIVE: Our goal was to determine if music perception was also impaired in subjects with acquired prosopagnosia, and if so, its anatomic correlate. METHOD: We studied eight subjects with acquired prosopagnosia, all of whom had extensive neuropsychological and neuroimaging testing. They performed a battery of tests evaluating pitch and rhythm processing, including the Montréal Battery for the Evaluation of Amusia. RESULTS: At the group level, subjects with anterior temporal lesions were impaired in pitch perception relative to the control group, but not those with occipitotemporal lesions. Three of eight subjects with acquired prosopagnosia had impaired musical pitch perception while rhythm perception was spared. Two of the three also showed reduced musical memory. These three reported alterations in their emotional experience of music: one reported music anhedonia and aversion, while the remaining two had changes consistent with musicophilia. The lesions of these three subjects affected the right or bilateral temporal poles as well as the right amygdala and insula. None of the three prosopagnosic subjects with lesions limited to the inferior occipitotemporal cortex exhibited impaired pitch perception or musical memory, or reported changes in music appreciation. CONCLUSION: Together with the results of our previous studies of voice recognition, these findings indicate an anterior ventral syndrome that can include the amnestic variant of prosopagnosia, phonagnosia, and various alterations in music perception, including acquired amusia, reduced musical memory, and subjective reports of altered emotional experience of music.

Perception of speaker sincerity in complex social interactions by cochlear implant users.

Understanding insincere language (sarcasm and teasing) is a fundamental part of communication and crucial for maintaining social relationships. This can be a challenging task for cochlear implant (CIs) users who receive degraded suprasegmental information important for perceiving a speaker's attitude. We measured the perception of speaker sincerity (literal positive, literal negative, sarcasm, and teasing) in 16 adults with CIs using an established video inventory. Participants were presented with audio-only and audio-visual social interactions between two people with and without supporting verbal context. They were instructed to describe the content of the conversation and answer whether the speakers meant what they said. Results showed that subjects could not always identify speaker sincerity, even when the content of the conversation was perfectly understood. This deficit was greater for perceiving insincere relative to sincere utterances. Performance improved when additional visual cues or verbal context cues were provided. Subjects who were better at perceiving the content of the interactions in the audio-only condition benefited more from having additional visual cues for judging the speaker's sincerity, suggesting that the two modalities compete for cognitive recourses. Perception of content also did not correlate with perception of speaker sincerity, suggesting that what was said vs. how it was said were perceived using unrelated segmental versus suprasegmental cues. Our results further showed that subjects who had access to lower-order resolved harmonic information provided by hearing aids in the contralateral ear identified speaker sincerity better than those who used implants alone. These results suggest that measuring speech recognition alone in CI users does not fully describe the outcome. Our findings stress the importance of measuring social communication functions in people with CIs.

Contraction of the stapedius and tensor tympani muscles explored by tympanometry and pressure measurement in the external auditory canal.

It has been suggested that tensor tympani muscle (TTM) contraction may be involved in the development of ear-related pathologies such as tinnitus, hyperacusis and otalgia, called the tonic tensor tympani syndrome (TTTS). However, as there is no precise measure of TTM function under normal and pathological states, its involvement remains speculative. When the TTM or the stapedius muscle (SM) contracts, they both generate an increase of middle ear stiffness that can be measured through middle ear admittance. However, this technique cannot differentiate the contraction between the two muscles. On the other hand, the air pressure measured in a sealed external auditory canal can provide a measure of the eardrum displacement that may be able to differentiate SM from TTM contraction. TTM is attached to the malleus, and its contraction causes a retraction of the eardrum inside the middle ear cavity, while SM can have a small but reversed effect on TTM displacement. To investigate this issue, we compared the middle ear admittance and air pressure in a sealed external ear canal upon auditory stimulation (sMEMC) and voluntary middle ear muscle contraction (vMEMC). In addition, we assessed the perceptual effect of vMEMC, including pitch and loudness matching of the fluttering noise produced by vMEMC and the threshold shifts, were measured. Out of the 14 ears tested, sMEMC was associated with a decrease of admittance in 93% (mean peak average: -0.06 ml, SD:0.04) and an increase of air pressure in 29% of ears (mean peak average: 8.1 Pa, SD:5.1). No decrease in air pressure was found upon sMEMC. For vMEMC (n = 8 ears), decreases were found for both admittance and air pressure in 100% and 88%, with a mean peak average of -0.38 ml, SD: 0.54 and -149 Pa, SD:156, for admittance and pressure respectively. These results suggest that SM and TTM are involved in sMEMC and vMEMC, respectively. In addition, vMEMC was associated with perceptual effects including a low-frequency sound, pitch-matched at ∼30 Hz (>15 dB SL), and a low-frequency hearing loss of at least 10 dB between 20 and 200 Hz. In conclusion, admittance and air pressure recordings provide useful and complementary information on middle ear muscle contraction and can be used to explore the middle ear function.

Apraxia of speech involves lesions of dorsal arcuate fasciculus and insula in patients with aphasia.

OBJECTIVE: To determine the contributions of apraxia of speech (AOS) and anomia to conversational dysfluency. METHODS: In this observational study of 52 patients with chronic aphasia, 47 with concomitant AOS, fluency was quantified using correct information units per minute (CIUs/min) from propositional speech tasks. Videos of patients performing conversational, how-to and picture-description tasks, word and sentence repetition, and diadochokinetic tasks were used to diagnose AOS using the Apraxia of Speech Rating Scale (ASRS). Anomia was quantified by patients' scores on the 30 even-numbered items from the Boston Naming Test (BNT). RESULTS: Together, ASRS and BNT scores accounted for 51.4% of the total variance in CIUs/min; the ASRS score accounted for the majority of that variance. The BNT score was associated with lesions in the left superior temporal gyrus, left inferior frontal gyrus, and large parts of the insula. The global ASRS score was associated with lesions in the left dorsal arcuate fasciculus (AF), pre- and post-central gyri, and both banks of the central sulcus of the insula. The ASRS score for the primary distinguishing features of AOS (no overlap with features of aphasia) was associated with less AF and more insular involvement. Only ∼27% of this apraxia-specific lesion overlapped with lesions associated with the BNT score. Lesions associated with AOS had minimal overlap with the frontal aslant tract (FAT) (<1%) or the extreme capsule fiber tract (1.4%). Finally, ASRS scores correlated significantly with damage to the insula but not to the AF, extreme capsule, or FAT. CONCLUSIONS: Results are consistent with previous findings identifying lesions of the insula and AF in patients with AOS, damage to both of which may create dysfluency in patients with aphasia.

Neurophysiological Differences in Emotional Processing by Cochlear Implant Users, Extending Beyond the Realm of Speech.

OBJECTIVE: Cochlear implants (CIs) restore a sense of hearing in deaf individuals. However, they do not transmit the acoustic signal with sufficient fidelity, leading to difficulties in recognizing emotions in voice and in music. The study aimed to explore the neurophysiological bases of these limitations. DESIGN: Twenty-two adults (18 to 70 years old) with CIs and 22 age-matched controls with normal hearing participated. Event-related potentials (ERPs) were recorded in response to emotional bursts (happy, sad, or neutral) produced in each modality (voice or music) that were for the most part correctly identified behaviorally. RESULTS: Compared to controls, the N1 and P2 components were attenuated and prolonged in CI users. To a smaller degree, N1 and P2 were also attenuated and prolonged in music compared to voice, in both populations. The N1-P2 complex was emotion-dependent (e.g., reduced and prolonged response to sadness), but this was also true in both populations. In contrast, the later portion of the response, between 600 and 850 ms, differentiated happy and sad from neutral stimuli in normal hearing but not in CI listeners. CONCLUSIONS: The early portion of the ERP waveform reflected primarily the general reduction in sensory encoding by CI users (largely due to CI processing itself), whereas altered emotional processing (by CI users) could be found in the later portion of the ERP and extended beyond the realm of speech.

Perception of musical pitch in developmental prosopagnosia.

Studies of developmental prosopagnosia have often shown that developmental prosopagnosia differentially affects human face processing over non-face object processing. However, little consideration has been given to whether this condition is associated with perceptual or sensorimotor impairments in other modalities. Comorbidities have played a role in theories of other developmental disorders such as dyslexia, but studies of developmental prosopagnosia have often focused on the nature of the visual recognition impairment despite evidence for widespread neural anomalies that might affect other sensorimotor systems. We studied 12 subjects with developmental prosopagnosia with a battery of auditory tests evaluating pitch and rhythm processing as well as voice perception and recognition. Overall, three subjects were impaired in fine pitch discrimination, a prevalence of 25% that is higher than the estimated 4% prevalence of congenital amusia in the general population. This was a selective deficit, as rhythm perception was unaffected in all 12 subjects. Furthermore, two of the three prosopagnosic subjects who were impaired in pitch discrimination had intact voice perception and recognition, while two of the remaining nine subjects had impaired voice recognition but intact pitch perception. These results indicate that, in some subjects with developmental prosopagnosia, the face recognition deficit is not an isolated impairment but is associated with deficits in other domains, such as auditory perception. These deficits may form part of a broader syndrome which could be due to distributed microstructural anomalies in various brain networks, possibly with a common theme of right hemispheric predominance.

Developmental Perceptual Impairments: Cases When Tone-Deafness and Prosopagnosia Co-occur.

Studies have shown subtle gray and white matter abnormalities in subjects with several developmental disorders including prosopagnosia, tone-deafness, and dyslexia. Correlational evidence suggests that tone-deafness and dyslexia tend to co-occur, suggesting a link between these two developmental disorders. However, it is not known whether tone-deafness can also be associated with other developmental disorders such as impaired face recognition or prosopagnosia. We addressed this question by assessing face perception abilities in a group of tone-deaf individuals and matched non-tone-deaf subjects. The Cambridge (CFMT) and the Warrington (WRMT) face memory tests were used to assess face processing in the combined group of 12, out of which six tested in the tone-deaf range. Only tone-deaf participants (two out of six) scored in the impaired range on the CFMT, one of whom was also impaired on the WRMT face memory test. Furthermore, the melodic composite score of all participants on the Montreal Battery of Evaluation of Amusia significantly correlated with their face recognition score on the CFMT. Our results suggest that in some cases tone-deafness might co-occur with face recognition impairments. It is implausible that both deficits are linked to a single cognitive dysfunction that spans different perceptual systems in different modalities. They are likely associated with a common pathogenetic mechanism of early development that leads to anomalies affecting the function of different brain systems or the connection between regions.

Cross-classification of musical and vocal emotions in the auditory cortex.

Whether emotions carried by voice and music are processed by the brain using similar mechanisms has long been investigated. Yet neuroimaging studies do not provide a clear picture, mainly due to lack of control over stimuli. Here, we report a functional magnetic resonance imaging (fMRI) study using comparable stimulus material in the voice and music domains-the Montreal Affective Voices and the Musical Emotional Bursts-which include nonverbal short bursts of happiness, fear, sadness, and neutral expressions. We use a multivariate emotion-classification fMRI analysis involving cross-timbre classification as a means of comparing the neural mechanisms involved in processing emotional information in the two domains. We find, for affective stimuli in the violin, clarinet, or voice timbres, that local fMRI patterns in the bilateral auditory cortex and upper premotor regions support above-chance emotion classification when training and testing sets are performed within the same timbre category. More importantly, classifier performance generalized well across timbre in cross-classifying schemes, albeit with a slight accuracy drop when crossing the voice-music boundary, providing evidence for a shared neural code for processing musical and vocal emotions, with possibly a cost for the voice due to its evolutionary significance.

Voice selectivity in the temporal voice area despite matched low-level acoustic cues.

In human listeners, the temporal voice areas (TVAs) are regions of the superior temporal gyrus and sulcus that respond more to vocal sounds than a range of nonvocal control sounds, including scrambled voices, environmental noises, and animal cries. One interpretation of the TVA's selectivity is based on low-level acoustic cues: compared to control sounds, vocal sounds may have stronger harmonic content or greater spectrotemporal complexity. Here, we show that the right TVA remains selective to the human voice even when accounting for a variety of acoustical cues. Using fMRI, single vowel stimuli were contrasted with single notes of musical instruments with balanced harmonic-to-noise ratios and pitches. We also used "auditory chimeras", which preserved subsets of acoustical features of the vocal sounds. The right TVA was preferentially activated only for the natural human voice. In particular, the TVA did not respond more to artificial chimeras preserving the exact spectral profile of voices. Additional acoustic measures, including temporal modulations and spectral complexity, could not account for the increased activation. These observations rule out simple acoustical cues as a basis for voice selectivity in the TVAs.

Sensitivity to musical emotions in congenital amusia.

The emotional experience elicited by music is largely dependent on structural characteristics such as pitch, rhythm, and dynamics. We examine here to what extent amusic adults, who have experienced pitch perception difficulties all their lives, still maintain some ability to perceive emotions from music. Amusic and control participants judged the emotions expressed by unfamiliar musical clips intended to convey happiness, sadness, fear and peacefulness (Experiment 1A). Surprisingly, most amusic individuals showed normal recognition of the four emotions tested here. This preserved ability was not due to some peculiarities of the music, since the amusic individuals showed a typical deficit in perceiving pitch violations intentionally inserted in the same clips (Experiment 1B). In Experiment 2, we tested the use of two major structural determinants of musical emotions: tempo and mode. Neutralization of tempo had the same effect on both amusics' and controls' emotional ratings. In contrast, amusics did not respond to a change of mode as markedly as controls did. Moreover, unlike the control participants, amusics' judgments were not influenced by subtle differences in pitch, such as the number of semitones changed by the mode manipulation. Instead, amusics showed normal sensitivity to fluctuations in energy, to pulse clarity, and to timbre differences, such as roughness. Amusics even showed sensitivity to key clarity and to large mean pitch differences in distinguishing happy from sad music. Thus, the pitch perception deficit experienced by amusic adults had only mild consequences on emotional judgments. In sum, emotional responses to music may be possible in this condition.

Modelling the dispersal of the two main hosts of the raccoon rabies variant in heterogeneous environments with landscape genetics.

Predicting the geographic spread of wildlife epidemics requires knowledge about the movement patterns of disease hosts or vectors. The field of landscape genetics provides valuable approaches to study dispersal indirectly, which in turn may be used to understand patterns of disease spread. Here, we applied landscape genetic analyses and spatially explicit models to identify the potential path of raccoon rabies spread in a mesocarnivore community. We used relatedness estimates derived from microsatellite genotypes of raccoons and striped skunks to investigate their dispersal patterns in a heterogeneous landscape composed predominantly of agricultural, forested and residential areas. Samples were collected in an area covering 22 000 km(2) in southern Québec, where the raccoon rabies variant (RRV) was first detected in 2006. Multiple regressions on distance matrices revealed that genetic distance among male raccoons was strictly a function of geographic distance, while dispersal in female raccoons was significantly reduced by the presence of agricultural fields. In skunks, our results suggested that dispersal is increased in edge habitats between fields and forest fragments in both males and females. Resistance modelling allowed us to identify likely dispersal corridors used by these two rabies hosts, which may prove especially helpful for surveillance and control (e.g. oral vaccination) activities.

Applying evolutionary concepts to wildlife disease ecology and management.

Existing and emerging infectious diseases are among the most pressing global threats to biodiversity, food safety and human health. The complex interplay between host, pathogen and environment creates a challenge for conserving species, communities and ecosystem functions, while mediating the many known ecological and socio-economic negative effects of disease. Despite the clear ecological and evolutionary contexts of host-pathogen dynamics, approaches to managing wildlife disease remain predominantly reactionary, focusing on surveillance and some attempts at eradication. A few exceptional studies have heeded recent calls for better integration of ecological concepts in the study and management of wildlife disease; however, evolutionary concepts remain underused. Applied evolution consists of four principles: evolutionary history, genetic and phenotypic variation, selection and eco-evolutionary dynamics. In this article, we first update a classical framework for understanding wildlife disease to integrate better these principles. Within this framework, we explore the evolutionary implications of environment-disease interactions. Subsequently, we synthesize areas where applied evolution can be employed in wildlife disease management. Finally, we discuss some future directions and challenges. Here, we underscore that despite some evolutionary principles currently playing an important role in our understanding of disease in wild animals, considerable opportunities remain for fostering the practice of evolutionarily enlightened wildlife disease management.

Severe recent decrease of adult body mass in a declining insectivorous bird population.

Migratory bird species that feed on air-borne insects are experiencing widespread regional declines, but these remain poorly understood. Agricultural intensification in the breeding range is often regarded as one of the main drivers of these declines. Here, we tested the hypothesis that body mass in breeding individuals should reflect habitat quality in an aerial insectivore, the tree swallow (Tachycineta bicolor), along a gradient of agricultural intensity. Our dataset was collected over 7 years (2005-2011) and included 2918 swallow captures and 1483 broods. Analyses revealed a substantial decline of the population over the course of the study (-19% occupancy rate), mirrored by decreasing body mass. This trend was especially severe in females, representing a total loss of 8% of their mass. Reproductive success was negatively influenced by intensive agriculture, but did not decrease over time. Interestingly, variation in body mass was independent of breeding habitat quality, leading us to suggest that this decline in body mass may result from carry-over effects from non-breeding areas and affect population dynamics through reduced survival. This work contributes to the growing body of evidence suggesting that declines in migratory aerial insectivores are driven by multiple, complex factors requiring better knowledge of year-round habitat use.

Predicting the sensitivity of butterfly phenology to temperature over the past century.

Studies to date have documented substantial variation among species in the degree to which phenology responds to temperature and shifts over time, but we have a limited understanding of the causes of such variation. Here, we use a spatially and temporally extensive data set (ca. 48 000 observations from across Canada) to evaluate the utility of museum collection records in detecting broad-scale phenology-temperature relationships and to test for systematic differences in the sensitivity of phenology to temperature (days °C(-1) ) of Canadian butterfly species according to relevant ecological traits. We showed that the timing of flight season predictably responded to temperature both across space (variation in average temperature from site to site in Canada) and across time (variation from year to year within each individual site). This reveals that collection records, a vastly underexploited resource, can be applied to the quantification of broad-scale relationships between species' phenology and temperature. The timing of the flight season of earlier fliers and less mobile species was more sensitive to temperature than later fliers and more mobile species, demonstrating that ecological traits can account for some of the interspecific variation in species' phenological sensitivity to temperature. Finally, we found that phenological sensitivity to temperature differed across time and space implying that both dimensions of temperature will be needed to translate species' phenological sensitivity to temperature into accurate predictions of species' future phenological shifts. Given the widespread temperature sensitivity of flight season timing, we can expect long-term temporal shifts with increased warming [ca. 2.4 days °C(-1) (0.18 SE)] for many if not most butterfly species.

The "Musical Emotional Bursts": a validated set of musical affect bursts to investigate auditory affective processing.

The Musical Emotional Bursts (MEB) consist of 80 brief musical executions expressing basic emotional states (happiness, sadness and fear) and neutrality. These musical bursts were designed to be the musical analog of the Montreal Affective Voices (MAV)-a set of brief non-verbal affective vocalizations portraying different basic emotions. The MEB consist of short (mean duration: 1.6 s) improvisations on a given emotion or of imitations of a given MAV stimulus, played on a violin (10 stimuli × 4 [3 emotions + neutral]), or a clarinet (10 stimuli × 4 [3 emotions + neutral]). The MEB arguably represent a primitive form of music emotional expression, just like the MAV represent a primitive form of vocal, non-linguistic emotional expression. To create the MEB, stimuli were recorded from 10 violinists and 10 clarinetists, and then evaluated by 60 participants. Participants evaluated 240 stimuli [30 stimuli × 4 (3 emotions + neutral) × 2 instruments] by performing either a forced-choice emotion categorization task, a valence rating task or an arousal rating task (20 subjects per task); 40 MAVs were also used in the same session with similar task instructions. Recognition accuracy of emotional categories expressed by the MEB (n:80) was lower than for the MAVs but still very high with an average percent correct recognition score of 80.4%. Highest recognition accuracies were obtained for happy clarinet (92.0%) and fearful or sad violin (88.0% each) MEB stimuli. The MEB can be used to compare the cerebral processing of emotional expressions in music and vocal communication, or used for testing affective perception in patients with communication problems.